Extending Amdahl's and Gustafson Baris's Laws by Adding Communication Overheads

Authors: Pham Van Hai, Ho Khanh Lam, Dung Nguyen Hoang*
https://doi.org/10.51316/jst.174.ssad.2024.34.2.3

Abstract

The extension of Amdahl's law and Gustafson-Barsis' law presented in this article provides insight into the relationship between communication costs and network topology in parallel computing. By considering communication latency in parallel computation execution time, these extensions can help researchers and developers optimize the interconnected network architecture of processing nodes and improve the performance of parallel computing systems. Today, parallel computer systems consisting of hundreds and thousands of processing nodes based on multiprocessor chip technology, high-speed optical transmission such as supercomputers are being researched, developed, and applied in many fields. many areas. Although chip technology has progressed to the 3nm process, the network architecture connecting processing nodes continues to be a problem that greatly affects the communication delay in the parallel computation time of the application problems. use. In this paper, extensions of Amdahl's law and Gustafson-Barsis' law are presented with the addition of communication costs depending on the topology of the topology. These extensions provide insight into the relationship between communication costs and network topology in parallel computing. By considering communication latency in parallel computation execution time, these extensions can help researchers and developers optimize the interconnected network architecture of processing nodes and improve the performance of parallel computing systems.

Keyword

Extensions of Amdahl’Law, Gustafson-Barsis, interconnection network topology, supercomputer, communication overhead, speedup.
Pages : 18-26

Related Articles:

Authors : Van Tong, Dong Le Van, Quynh Anh Vu, Tuan Anh Ngo, Duc Tran*
Authors : Thi-Van-Anh Nguyen, Xuan-Hiep Nguyen, Quy-Thinh Dao*
Authors : Hoang Van Hiep, Nguyen Dinh Thuan, Pham Ngoc Hung, Ta Hai Tung, La The Vinh*